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Abstract: This paper is concerned with a mean-field linear quadratic (LQ, for short) optimal control 
problem with deterministic coefficients. It is shown that convexity of the cost functional is necessary for the 
finiteness of the mean-field LQ problem, whereas uniform convexity of the cost functional is sufficient for 
the open-loop solvability of the problem. By considering a family of uniformly convex cost functionals, a 
characterization of the finiteness of the problem is derived and a minimizing sequence, whose convergence is 
equivalent to the open-loop solvability of the problem, is constructed. Then, it is proved that the uniform 
convexity of the cost functional is equivalent to the solvability of two coupled differential Riccati equations 
and the unique open-loop optimal control admits a state feedback representation in the case that the cost 
functional is uniformly convex. Finally, some examples are presented to illustrate the theory developed. 
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1 Introduction 


Let F, P) be a complete filtered probability space on which a standard one-dimensional Brownian 

motion W = {W{t)-,0 ^ t < oo} is defined, where F = {J5}t>o is the natural filtration of W augmented by 
all the P-null sets in Consider the following controlled linear stochastic differential equation (SDE, for 
short) on a finite horizon [t, T]: 

{ dX{s) = {a(s)A(s) -b A(s)E[A(s)] -b B{s)u{s) + B{s)E[u{s)] -b 6(s)|ds 

-b {c(s)A(s) -b (7(s)E[A(s)] -b D{s)uis) + £»(s)E[u(s)] -b (7(s)}dIT(s), s € [t,T], 

X{t) = e, 

where A(-), B{-), B{-), C(-), C(-), D{-), D{-) are given deterministic matrix-valued functions; &(•), cr(-) 

are vector-valued F-progressively measurable processes and ^ is an J^-measurable random vector. In the 
above, u(-) is the control process and A(-) is the corresponding state process with initial pair (t,^). For any 
t £ [0,T), we define 


U[t,T] = lu: [t,T] X n 


m(-) is F-progressively measurable, E / |M(s)pds < oo 
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Any u(-) € U[t^T] is called an admissible control (on [t,T]). Under some mild conditions, for any initial 
pair (t,^) with ^ being square-integrable and any admissible control u(-) € U\t,T], (1.1) admits a unique 
square-integrable solution X{-) = X{- Now we introduce the following cost functional: 


J(t, u(-)) = E<^ (GX(T), X{T)) + 2{g, X{T)) + (GE[A(T)], E[A(T)]) + 2{g, E[X{T)]) 


( 1 . 2 ) 



(q{s) S{s)A(x{s)\ 

1^5(s) R{s) ) \ u{s)) ’ u{s) jj \ l^p(s )) ’ u{s) j 


ds 


(Q{s) 5(s)^We[A(s)]\ (e[X{s)]\\ I (q{s)\ /e[A(s)]\ 

1^5(s) R{s) ) l^E[u(s)] ) ’ i^E[u(s)]y/ \\p{s)) ’ l^EK^)] ) 



where G, G are symmetric matrices and Q{-), Qi'), S{-), <5(-), i?(-), R{-) are deterministic matrix-valued 
functions with Q{-)^ = Q{-), Q{-)^ = Q{-), Ri')^ = R{'), R{')^ = R{')', 9 is an J’T-measurable random 
vector and 5 is a (deterministic) vector; q{-), p(-) are vector-valued F-progressively measurable processes and 
g(-), p(-) are deterministic vector-valued functions. Our mean-field stochastic LQ optimal control problem 
can be stated as follows: 


Problem (MF-LQ). For any given initial pair (t,^) € [0,T) x L3r^(fl;K”), find a «*(•) € U[t^T\ such 
that 

(1.3) J(f,^;u*(.))= ini 

«(.)GW[t,T] 

In the above, is the space of all J^t-measurable, K”-valued random vectors ^ with E|^p < 00 . 

Any u*{-) G U[t,T] satisfying (1.3) is called an {open-loop) optimal coutro/of Problem (MF-LQ) for the initial 
pair (t,^), and the corresponding A*(-) = X{- ;t,^,u*{-)) is called an optimal state process. The function 
U(-, •) is called the value function of Problem (MF-LQ). In the special case of b{-), a{-), g{-), §{■), q{-), q{-), 
P(‘)i pi') = Oj denote by J°(t, u(-)), V°{t,f) and Problem (MF-LQ)° the corresponding cost functional, 

value function and Problem (MF-LQ), respectively. 


Comparing with the classical stochastic LQ optimal control problem, a new feature of Problem (MF- 
LQ) is that both the state equation and the cost functional involve the states and the controls as well as 
their expectations. In this case, we call (1.1) a controlled mean-field (forward) SDE (MF-SDE, for short). 
The history of MF-SDEs can be traced back to the work of Kac [18] in 1956 and McKean [21] in 1966. 
Since then, many researchers have made contributions to such kind of equations and applications; see, for 
example, Dawson [12], Dawson-Gartner [13], Scheutzow [24], Gartner [14], Graham [15], Chan [9], Chiang 
[10] and Ahmed-Ding [2] . For recent development of MF-SDEs, readers may refer to Huang-Malhame-Caines 
[17], Veretennikov [27], Mahmudov-McKibben [20], Buckdahn-Djehiche-Li-Peng [7], Buckdahn-Li-Peng 
[ 8 ], Borkar-Kumar [5], Crisan-Xiong [11], Kotelenez-Kurtz [19] and the references cited therein. Control 
problems of ME-SDEs were studied by Ahmed-Ding [3], Ahmed [1], Park-Balasubramaniam-Kang [23], 
Buckdahn-Djehiche-Li [ 6 ], Andersson-Djehiche [4], Meyer-Brandis-0ksendal-Zhou [22], and so on. More 
recently, Yong [28] investigated an LQ problem for MF-SDEs in finite horizons and gave some interesting 
motivation for the control problem with E[A(-)] and E[it(-)] being included in the cost functional. Later, 
Huang-Li-Yong [16] generalized the results in [28] to the case with an infinite time horizon. 


In [28], two coupled differential Riccati equations are derived by decoupling the optimality system. It is 
shown that under certain conditions, the two Riccati equations are uniquely solvable and Problem (MF-LQ) 
admits a unique optimal control which has a state feedback representation. To be precise, if 


(1.4) 


G, G -f G ^ 0, Qis), Qis) + Q{s) ^ 0, 

S{s) = S{s) = 0, R{s), Ri-s) + R{s) SI, 
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for some (5 > 0, then the unique solvability of the two Riccati equations can be obtained from the classical 
result [29, Theorem 7.2]. However, examples show that the two Riccati equations might still be solvable 
even if both R{-) and R{-) are negative semi-definite (see Example 6.1). On the other hand, it may happen 
that Problem (MF-LQ) is open-loop solvable, while the optimal control cannot be obtained by solving the 
corresponding Riccati equations due to the possible singularities of the terms R + PD and i? -|- R -|- 
{D + D)^P{D -I- D) (see Example 6.2). Thus, some questions arise naturally: (a) What is the relationship 
between Problem (MF-LQ) and the solvability of the two Riccati equations? (b) How can we characterize 
the open-loop solvability of Problem (MF-LQ)? (c) How can we find an optimal control in general? The 
purpose of this paper is to study Problem (MF-LQ) from an open-loop point of view and to address the 
above issues. Closed-loop mean-field LQ problems will be investigated in a forthcoming paper. 

Our main idea and results of this paper can be informally described as follows. By a representation of the 
cost functional, we first show that for the open-loop solvability of Problem (MF-LQ), a necessary condition is 
the convexity of the cost functional and a sufficient condition is the uniform convexity of the cost functional. 
Under the convexity condition, by adding eE \u{s)\'^ds (e > 0) to the original cost functional, we get a 
family of uniformly convex functionals. The corresponding mean-field LQ problems admit unique optimal 
controls u*(-), e > 0, which form a minimizing sequence of Problem (MF-LQ). Then the open-loop solvability 
of Problem (MF-LQ) is characterized by the convergence of the sequence, whose limit is an optimal control 
of Problem (MF-LQ). To construct u*(-) explicitly, we further investigate Problem (MF-LQ) with uniformly 
convex cost functionals. Since the uniform convexity condition is much weaker than (1.4), the result in [28] 
fails to apply to this case. To overcome this difficulty, we reduce Problem (MF-LQ) to a classical stochastic 
LQ problem and a deterministic LQ problem. By making use of a result found in [25], we establish the 
equivalence between the uniform convexity of the cost functional and the solvability of the two Riccati 
equations. Then by the completion of squares technique, we obtain a state feedback representation of the 
optimal control via the solutions of the two Riccati equations. 

The rest of the paper is organized as follows. Section 2 gives some preliminaries. In Section 3, we 
study Problem (MF-LQ) from a Hilbert space viewpoint and derive necessary and sufficient conditions for 
the finiteness and open-loop solvability of the problem by considering a family of uniformly convex cost 
functionals. Section 4 shows that the solvability of two coupled Riccati equations is necessary for the 
uniform convexity of the cost functional. In Section 5, we further prove that the solvability of the two 
coupled Riccati equations is also sufficient for the uniform convexity of the cost functional. Moreover, a 
state feedback representation is obtained for the optimal control. Some illustrative examples are presented 
in Section 6. 


2 Preliminaries 

Throughout this paper, we denote by the Euclidean space of all n x m real matrices, and by §” 

the space of all symmetric n x n real matrices. Recall that the inner product (• ,•) on is given by 

(M, N) I—>■ tr N), where the superscript T denotes the transpose of vectors or matrices, and the induced 

norm is given by \M\ = M). When there is no confusion, we shall use (•, •) for inner products in 

possibly different Hilbert spaces, and denote by | • | the norm induced by (• ,•). For a matrix M £ 
we denote by TZ{M) the range of M, and if M £ S", we use the notation M > 0 (^ 0) to indicate that M 
is positive (semi-) definite. For a bounded linear operator A form a Banach SP space into another Banach 
space '3^, we denote by A* the adjoint operator of A. Let T > 0 be a fixed time horizon. For any t £ [0, T] 
and Euclidean space H, we let (1 ^ p ^ oo) be the space of all H-valued functions that are 
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L^-integrable on [t,T] and T]; H) be the space of all H-valued continuous functions on [t,T]. Next, we 
introduce the following spaces: 


L^^(r 2 ;]HI) = —>• H I ^ is J't-measurable, < oo|, 

Lp(t,T;IHI) = : [t,T] X f] —>• HI I (/?(•) is F-progressively measurable, |<p(s)pds < oo| , 

Lf(i};C{[t,T];M.)) = < (^ : [t,T] x n —>• H I (p{-) is F-adapted, continuous, E [ sup |</?(s)p ) < oo > , 

i \s^[t,T] J J 

Lf{il-,L^{t,T;M.)) = : [t, T] X n —>• HI I </?(•) is F-progressively measurable, E |(/j(s)|ds^ < ooj- . 

Further, we introduce the following notation: For any S"-valued measurable function F on [t,T], 


F > 0 

F(s) ^ 0, 

F > 0 

F{s) > 0, 

F» 0 

F{s) ^ SI, 


a.e. s G [t, T], 
a.e. s G [t, r], 

a.e. s G [t,T], for some <5 > 0. 


The following assumptions will be in force throughout this paper. 

(HI) The coefficients of the state equation satisfy the following: 

j A{-),A{-) G Li(0,T;lR’"^”), G T; 6 (.) g lI{VI-L\Q,T-W)), 

\ C)-), C(-) G L\0, T; D(-), £>(•) G L°°(0, T; a{-) G L|(0, T; K"). 

(H2) The weighting coefficients in the cost functional satisfy the following: 

r Q(-),0(-)ei'(0,T;S”), Si-),Si)GL\0,T;R^^^), R{-), R{-) € 

I gGL3.^(ff;R"), g(-)GL2(f^;ii(o,T;K-)), p(.) G L2 (o,T;R-), 

[gGK", 9 (-) G Li(0,r;R"), p(-) G ^^(0,T;R™), G,GgS’". 

By a standard argument using contraction mapping theorem, one can show that under (HI), for any 
(t,^) G [0,r) X L‘^^{Q;W^) and any u{-) G U[t,T], (1.1) admits a unique solution X{-) = X{- ;t,^,u(-)) G 
Lp(n; G([t, T]; R")). Hence, under (H1)-(H2), the cost functional (1.2) is well-defined, and Problem (MF- 
LQ) makes sense. Now we introduce the following definition. 

Definition 2.1. (i) Problem (MF-LQ) is said to be finite at initial pair (t,^) G [0,T] x L3^^(H;R") if 

(2.1) F(t,e)>-oo. 

Problem (MF-LQ) is said to be finite att G [0, T] if (2.1) holds for all f G (H; R"), and Problem (MF-LQ) 
is said to be finite if it is finite at alH G [0, T]. 

(ii) Problem (MF-LQ) is said to be {uniquely) open-loop solvable at initial pair {t,^) G [0,T] x L^^(H;R") 
if there exists a (unique) u*{-) G U[t,T] satisfying (1.3). Problem (MF-LQ) is said to be {uniquely) open-loop 
solvable at t if for any ^ G L3^^(H;R"), there exists a (unique) u*{-) G U[t,T] satisfying (1.3), and Problem 
(MF-LQ) is said to be {uniquely) open-loop solvable {on [0,r)) if it is (uniquely) open-loop solvable at all 
tG [0,T). 
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Next, we introduce the following mean-field backward SDE (MF-BSDE, for short) associated with the 
state process X(-) = X{- 


( 2 . 2 ) 


' dY{s) = -^A^Y + A^]E[r] -f C^Z + C^E[Z] + QX + Q]E[X] 

^ -I-S'^M-I--f g-f g|ds-I-Z(iVE(s), s€[t,T], 

^ Y{T) = GX{T) + GE[X{T)] +g + g. 


The following result is concerned with the differentiability of the map u(-) i—>■ J(t,^;it(-)). 

Proposition 2.2. Let (H1)“(H2) hold and t € [0,T) be given. For any ^ ^ 

u(-),v(-) S U\t, T], the following holds: 


J{t,^;u{-) + Xv{-)) - J{t,^;u{-)) 

(2.3) = AV°(t,0;z;(-))+ 2AE^ (B^Y + B^E[Y] + Z + D^E[Z] 

+ SX + 5E[X] + Ru + /^E[m] + p + v)ds, 

where Ar(-) = X{- ;t,^,'u(-)) and (F(-),Z'(-)) is the adapted solution to the MF-BSDE (2.2) associated with 
X(-). Consequently, the map u(-) >—>■ J(t,^;u(-)) is Frechet differentiable with the Frechet derivative given 
by 

VJ{t,C,u{-)){s) = 2|b(s)^F(s) + B(s)^E[r(s)] + D{s)^Z{s) + D{s)^E[Z{s)] + S{s)X{s) 

(2.4) ^ . 

-I- 5'(s)E[X(s)] -I- R{s)u{s) -I- i?(s)E[M(s)] -f p{s) -f p(s)] |, s e[t,T]. 

Proof. Let X{-) = X{- ;t,^,'«(.) -I- Xv{-)) and Xo(’) be the solution to the following MF-SDE: 

' dXois) = {Ai(s)Xo(s) + i(s)E[Xo(s)] + B{s)v{s) + B(s)E[u(s)]}ds 
< +\^G{s)Xo{s)+C{s)E[Xo{s)]+D{s)v{s)+D{s)E[v{s)]'jdW{s), s e [t,T], 

. Xoit) = 0 , 

By the linearity of the state equation, X(.) = Ar(.) -f AAro(.). Hence, 


+ Xv{-)) - J(t,C;u(.)) 

= AeJ (G[2X(T) + AXo(r)],Xo(r)) + 2{g,XoiT)) 


Q 

.S R , 


2X + XXo 
, 2u + Xv , 


^^0 
. V , 


+ 2 ' 


q 

<Pj 


'Xo' 
, V , 


'q s^\ / 2E[a:] + ae[a:o] 

^5 E y 2E[u] -f AEH 

= 2 Ae|(GX(T)+5,Xo(T))+j^^ 

Vq (Xo 

\s R \ V 


E[Xo] 

EH 


ds 


— I ’ 

\Pj 


+ a| (g(2E[X(T)] + AE[Xo(r)]),E[Xo(T)]) + 2(3,E[Xo(T)]) 

+ 2 

{Q^ + iS*' u + Q, -^o) “t“ {SX + Ru /), v) 

t 

+ X^e\{GXo{T),Xo{T))+ i\z 


E[Xo] 

EH 


ds 


'Xo 
. V . 


ds 
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+ 2A<; (GE[X(r)]+ 5 ,E[Xo(r)])+ / (QE[X] + 5^E[u]+9,E[Xo]) + (5E[X] + i«[M]+p,E[i;]) 

sA /e[Xo]\ fE[Xo] 




Jt 

pT 


ds 


+ A^<^(GE[Xo(r)],E[Xo(T)]) 


It \\s R J \ EH J ’ EH 

= 2XE{ {GX{T) + GE[X(r)] +g + g, Xo{T)) 

.r- 


' ds 




((5^ + QE[X] + S'^m + /S'^EH] + 9+(Z,-^o) + (<S'-^ + 5'E[X] + iiu+i?EH] + p+p, v) 

Jt ^ 

Now applying Ito’s formula to s i—(y(s), Xo(s)), we have 
E(GX(r) + GE[X(T)] + g + g, Xo{T)) 


ds 


= E 


= E 


{- + Az + G'^E[H +QX + QE[X] + S^u + S'^EH] +q + q, X^) 

+ (^ATo + iE[Xo] + Bv + BE[v],Y) + {CXq + GE[Xo] + Dv + DE[v],Z)'^ds 
l^{B^Y + B^E[Y] + Z + D^E[Z],v) - (QAT + 0E[As:] + + 5^EH + g + g,Xo)}ds. 


(2.5) 


Combining the above equalities, we obtain (2.3). □ 

From the above, we have the following result, which gives a characterization for the optimal controls of 
Problem (MF-LQ). 

Theorem 2.3. Let (H1)-(H2) hold and (t,^) € [0,T) x L3r^(0;]R") be given. Let u*(-) € tl[t,T] 
and (X*(-), y*(-), y*(-)) he the adapted solution to the following (decoupled) mean-held forward-backward 
stochastic differential equation (MF-FBSDE, for short): 

' dx*(s) = |aX* + TE[A:*] + Bu* + BE[u*] + b^ds 

+ l^cx* + CE[X*] + Du* + DE[u*] + a^dW{s), s € [t,T], 

dY*{s) = + A^E[Y*] + C^Z* + G^EH*] + QX* + QE[A:*] 

+ S^u* + 5^EH*] +q + g}ds + Z*dW{s), s € [t, T], 

X*{t) = G Y*{T) = GX*{T) + GE[X*(T)] +g + g. 

Then u*{-) is an optimal control of Problem (MF-LQ) for the initial pair (t,^) if and only if 

(2.6) J°(t,0;M(-)) ^ 0, \/ui-) €U[t,T], 

and the following stationarity condition holds: 

VJ{t,^;u*{-)) = 2l^B^Y* + Z* + SX* + Ru* + p 

+ B^E[Y*] + D^E[Z*] -f S'E[A:*] -f RE[u*] -f pj = 0, a.e. a.s. 

Proof. By (2.3), we see that u*{-) is an optimal control of Problem (MF-LQ) for the initial pair (t,^) if 
and only if 

AV°(C0;n(-)) + AE J {VJ{t,f-u*{-)){s),u{s))ds 
= j{t,f]u*{-) + Xu{-))-J{t,f-u*{-))fiO, VAsK, Vit(-) eG[t,r], 


(2.7) 
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which is equivalent to (2.6) and the following: 


{VJ{t,^;u*{-)){s),u{s))ds ^0, Vm(-) e W[t,T], 

Note that the above inequality holds for all m(-) G U[t,T] if and only if {■)){■) = 0. The result 

therefore follows. □ 


3 Finiteness and Open-Loop Solvability of Problem (MF-LQ) 

We begin with a representation of the cost functional. For any u{-) G U[t,T], let Xq{-) be the solution of 

{ dX^{s) = {a(s)X“(s) + A(s)E[Xo“(s)] + B{s)u{s) + B(s)E[w(s)]}ds 

+ {c'(s)X“(s) +C(s)E[X“(s)] +Z?(s)w(s) +.D(s)E[w(s)]}dW(s), s G [t,T], 

X^it) = 0. 


By the linearity of (3.1), we can define bounded linear operators Ct : U[t,T] —>■ Lp(t,T;]R") and Ct : 
U\t,T] L^^(n;R”) by u{-) !->■ Xq{-) and u{-) Xq{T), respectively, via the MF-SDE (3.1). Then 


J°(t,0;«(-)) = E 


(GX“(T),X“(T)) + (GE[X“(T)],E[X“(r)]) 


+ 



+ 



(q{s) 5(s)t\ /Xo“(s)\ 

\Sis) Ris) ) \u{s) )\uis) jl 

( q { s ) 5(s)t\ /e[Xo“(s)A /e[Xo“(s)]\\ 1 

\S{s) Ris) ) \E[u{s)] )\ e [ u { s )] ) / j 


= (GCtu, Ctu) + (GE[£tit], E[£tit]) + (^QCtu, Ctu) + 2(^S£tu, tt) + (i?M, m) 


+ (QE[£tu],E[£tu]) + 2(,§E[£tit],E[M]) + (i?E[M],E[u]) 

= ([£*(G + E*GE)£t + C;iQ + E*QE)Ct + (5 + E*5E)£t + CUS^ + E*5^E) + {R + E*i?E)] w, u). 


Denote 


(3.2) Mt = £*tiG + ]E*GE)£t + £*(Q + E*QE)£t + {5 + E*5'E)£t + £*(5^ + E*5^E) + (i? + E*i?E), 


which is a bounded self-adjoint linear operator on U[t,T]. Then by Proposition 2.2, the cost functional 
can be written as 

Jit,C,ui-)) = {Mtu,u) + (£>J(£C;0),u) + Jit,^]0), 

V(£e)G [0,T]x£^^(D;R-), Vui-) G U[t,T]. 


Now let us introduce the following conditions. 

(H3) The following holds: 

(3.4) J°(£0;m(-)) ^ 0, Vm(-)gG[£T]. 


(H4) There exists a constant <5 > 0 such that 


(3.5) 


J°(t, 0; u(-)) ^ (5E / |it(s)pds. 


Vm(-) GG[£T]. 
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From (3.3), we see that the map it(-) is convex if and only if 


(3.6) Mt ^ 0, 

which is also equivalent to (H3), and «(•) i—> J(t,^;u{-)) is uniformly convex if and only if 

(3.7) Mt ^ SI, for some (5 > 0, 

which is also equivalent to (H4). The following result tells us that (H3) is necessary for the finiteness 
(and open-loop solvability) of Problem (MF-LQ) at t, and (H4) is sufficient for the open-loop solvability of 
Problem (MF-LQ) at t. 

Proposition 3.1. Let (H1)-(H2) hold and t £ [0,T) be given. We have the following: 

(i) If Problem (MF-LQ) is Unite at t, then (H3) must hold. 

(ii) Suppose (H4) holds. Then Problem (MF-LQ) is uniquely open-loop solvable at t, and the unique 
optimal control for the initial pair (t,^) is given by 


(3.8) 

Moreover, 

(3.9) 


u*{-) = -^Mt^VJ{t,^-0){-). 


V{t,c) = J(t,e;0) - i \m, -^vj[t,^-bf 


Proof, (i) We prove the result by contradiction. Suppose that J°(t,0 ;m(-)) < 0 for some u{-) £ U[t,T]. 
By Proposition 2.2, we have 

J{t, Xu{-)) = J{t, 0) -h X^J°{t, 0; u{-)) + {VJ{t, 0){s),u{s))ds, VA € R. 

Letting A —>■ oo, we obtain that 

V(t,f)^ lim J(t,f]Xu(-))=—oo, 

X—¥oo 

which is a contradiction. 

(ii) Suppose (H4) holds. Then the operator Mt is invertible, and 




Mfu+^Mt ~^VJ{t,f-t)) 
1 


+ J{t,f-b)--^\Mt ^PJ(t,e;0)|', 


> J(t,e;0)-- Mt ~^VJ{t,f-Q) 

Note that the equality in the above holds if and only if 

1 


Ve € L^^(f2;IR"), £U[t,T]. 


u = -^Mf^VJit,f;0). 


The result therefore follows. 


Due to the necessity of (H3) for the finiteness of Problem (MF-LQ), we will assume (H3) holds in the 
rest of this paper. Now for any e > 0, consider state equation (1.1) and the following cost functional: 


(3.10) 


\u{s)\'^ds 


= {{Mt + el)u, u) -I- {T>J{t, 0), u) -£ J{t, f-, 0). 










Denote the corresponding optimal control problem and value function by Problem (MF-LQ)^ and 14(- ,•), 
respectively. By Proposition 3.1, part (ii), for any ^ G Problem (MF-LQ)^ admits a unique 

optimal control 


(3.11) 




and the value function is given by 


(3.12) 


Ve{t,0 = \\iMt+sI)---VJit,C,0) 


Now, we are ready to state the main result of this section. 

Theorem 3.2. Let (H1)“(H3) hold and ^ G L3r^(D;R”). We have the following: 

(i) lime_^o Ve{t, C) = ^0- particular, Problem (MF-LQ) is finite at {t, () if and only if {14(t, C)}e>o 
is bounded from below. 


(ii) The sequence {u*(-)}e>o defined by (3.11) is a minimizing sequence of u{-) i—>■ J{t, u{-)): 


(3.13) 



(iii) The following statements are equivalent: 

(a) Problem (MF-LQ) is open-loop solvable at 

(b) The sequence {u*(-)}£>o is bounded in U[t,T]; 

(c) The sequence {u*(-)}£>q admits a weakly convergent subsequence; 

(d) The sequence {u*(-)}e>o admits a strongly convergent subsequence. 

In this case, the weak (strong) limit of any weakly (strongly) convergent subsequence of {u*(-)}e>o is an 
optimal control of Problem (MF-LQ) at (t,^). 

To prove Theorem 3.2, we need the following lemma. 

Lemma 3.3. Let % be a Hilbert space with norm | • | and 0, G "H, n = 1, 2, • • •. 

(i) If 9n ^ d weakly, then |0| ^ lim |0„|. 


(ii) On ^ 9 strongly if and only if 


\9n\ —>■ \9\ and 9n ^ 9 weakly. 


Proof of Theorem 3.2. (i) For any £2 > ei > 0, we have 


Je 2 {t,^',u(-)) > j£i(i,^;M(-)) ^ J(t,^;u(-)), Vu(-) G U[t,T] 


which implies that 


(3.14) 


^^2 { t , 0 > { t : 0 > ^ { t , 0: V£2 > £1 > 0. 


Thus, the limit lim£_>o 14 (t,^) exists and 


(3.15) 


V(t,f) = linil4(t,^) ^ V(t,f). 
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On the other hand, for any K, S > 0, we can find a u^{-) G U[t, T], such that 

^ [ |M^(s)pds < max{t/(t,^), —it'} + (5 + eE f \u^{s)\‘^ds. 

Jt Jt 

Letting e —>■ 0, we obtain that 


y(t, ^ max{y(t, —iLj + (5, VitT, (5 > 0, 


from which we see that 

(3.16) V{t,0^V{t,0- 

Combining (3.15)-(3.16), we obtain the desired result. 

(ii) If V{t,^) > —oo, then by (i), we have 

seJ^^ \u;is)\^ds = = vs,0 - 

^ —>■ 0 as e —>■ 0. 

Hence, 


lini J(t,^;M*(.)) = liin 

£->0 e-J-O 




= vit,0- 


If V{t,^) = —oo, then by (i), we have 

^ =Ve{t,C) ^-oo as e-J^O, 


and (3.13) still holds. 

(hi) (b) => (c) and (d) (c) are obvious. We next prove (c) => (a). Let (•)}/=>! be ^ weakly 

convergent subsequence of {u*(-)}e>o with weak limit u*{-). Then {Mej,(O lfcjsi is bounded in U[t,T]. For 
any u(-) G U[t,T\, we have 


(3.17) J(t,e;<(-))+efcIE^ K(s)|2ds = KjCO ^ «(•)) +|«(s)|2ds. 


Note that it(-) i—>■ is sequentially weakly lower semi-continuous. Letting fc —oo in (3.17), we 

obtain 

^ ]m Vm(.) G ii[t,T]. 

k—¥C!0 

Hence, u*{-) is an optimal control of Problem (MF-LQ) at Now it remains to show (a) (b) and (a) 

=> (d). Suppose v*{-) is an optimal control of Problem (MF-LQ) at (t,^). Then for any e > 0, we have 


Ve{t,^) = > V{t,^)+eE |u*(s)pds, 

V,{t,0 ^ Je{t,tv*{-)) = V{t,0+£K£ 


from which we see that 

(3.18) 




^EJ^ |7;*(s)|2ds, V£>0. 
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Thus, {Me(-)}e>o is bounded in the Hilbert space lA[t,T] and hence admits a weakly convergent subsequence 
Let u*{-) be the weak limit of By the proof of (c) => (a), we see that u*{-) is also 

an optimal control of Problem (MF-LQ) at Replacing v*{-) with u*{-) in (3.18), we have 


(3.19) 


E 


|u*(s)pds < E / |u*(s)pc?s. 


Also, by Lemma 3.3, part (i). 


Ve > 0. 


(3.20) 


E f |M*(s)|^(is ^ lim E / |m*^( s)|^(is. 
Jt fc—fOO Jt 


Combining (3.19)-(3.20), we have 


E [ |u*(s)p(is = lim E [ \u*{s)\'^ds. 

Jt Jt 

Then it follows from Lemma 3.3, part (ii), that (•)}fcj>i converges to u*(-) strongly. 


□ 


4 Necessary Conditions for the Uniform Convexity and Riccati 
Equations 


Theorem 3.2 tells us that in order to solve Problem (MF-LQ), we need only solve mean-filed LQ problems with 
uniformly convex cost functionals and then pass to the limit. By Proposition 3.1, under the uniform convexity 
condition (H4), the unique optimal control u*(-) for the initial pair (f,f) is determined by (3.8). However, 
such a representation is not easy to compute, since is in an abstract form and very complicated. Thus, 
we would like to find some more explicit form of the optimal control. In this section we shall investigate 
uniform convexity of the cost functional and show the necessity of solvability of two Riccati equations for 
the uniform convexity of the cost functional. 

First, we present the following result concerning the value function of Problem (MF-LQ)°. 

Proposition 4.1. Let (H1)-(H2) and (H4) hold. Then there exists a constant a G R such that 
(4.1) l/°(s,0^aE[|Cp], V(s,0 € [t,T] X with El^]=0. 


Proof. For any s G [t,T] and any u(-) G W[s,T], we define the zero-extension of «(•) as follows: 


(4.2) 


[0I[t,s) ® u{-)]{r) 


0, r G [t,s), 
u{r), rG[s,r]. 


Then v{-) = ® w(‘) ^ and due to the initial state being 0, the solution AIq(-) of 

( dXg{r) = {A(r)Aro(r) -|-A(r)E[Xo (r)] B{r)v{r) -|-i?(r)E[u(r)]}dr 

< + {C{r)XS{r) + C{r)E[X^{r)] + D{r)v{r) + D{r)E[v{r)]}dW{r), r G [t,T], 

i^o(t)=0, 

satisfies XQ{r) = 0, r G [t, s]. Hence, 

j-T nT 

(4.3) J°(s,0;m(-)) = J°(t, 0;0/[t,s) ©ii(-)) > (5Ey \[0I[t,s) ® u{-)]{r)\'^dr = SE J \u{r)\'^dr. 
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Now, let {X{-),Y{-), Z{-)) be the solution of the following (decoupled) MF-FBSDE: 

{ dX{r) = {AX + AE[X]}dr + {CX + CE[X]}dW{r), r G [s,T], 
dY{r) = -{A^Y + A^E[Y] + Z + C^E[Z] + QX Y QE[X])dr + ZdW{r), r G [s,T], 
X(s) = Y{T) = GX{T) + GE[X(T)]. 

By Proposition 2.2 and (4.3), we have 


j°(s,G4-))->/°(s,C;0) 

= J°(s,0;«(•)) +2E [ {b'^Y+B^E[Y]+D^Z+D^E[Z] + SX + SE[X],u) 


dr 


(4-5) fT 1 _ _ _ n 

J°(s,0;m(-)) -<5E / \u{r)fdr--E / \B^Y+B^E[Y] + D^ Z+D^E[Z] + SX + SE[X]\ dr 

--E / \B^Y+B^E[Y] + D^Z+D^E[Z] + SX + ^[X]\^dr. 

^ J S 




Y -- 


If E[^] = 0, then E[X(-)] = 0, and one can verify that 


(4.6) X{r) = X(r)X(s)-iG Y{r) = Y{r)X{s)-^i, Z{r) = Z(r)X(s)-^^, r G [s,T], 


where X(-) is the solution to the following ]R"^"-valued SDE: 

( 4 . 7 ) + .,[ 0 .^, 

1 X(0) = J, 

and (¥(•), Z(-)) is the adapted solution to the following ]R”^”-valued backward SDE (BSDE, for short): 


(4.8) 


J dY(r) = -[A(r)^Y(r) + C(r)^Z(r) + Q(r)X(r)]dr + Z(r)dW(r), rG [0,T], 
\ Y(T) = GX(T). 


Note that X(r)X(s) Y(r)X(s) ^ and Z(r)X(s) ^ are independent of Xs- Thus, E[X(-)] = E[E(-)] 
E[Z{-)] = 0 and (noting (4.5)) 

J°(s, G ^^(•)) ^ G 0) - ^E £ \B{r)^Y{r) + D{r)^Z{r) + S{r)X{r)fdr 

= e|(GX(T),X(T))+^ {Q{r)X{r),X{r))dr'^ - \B{r)^Y{r) + D{r)^ Z{r) + Sir)X{r)\'^dr 

= E|e^ |^[X(s)-i]^X(T)^GX(T)X(s)-i+^ [X(s)-i]^X(r)^Q(r)X(r)X(s)-idrj 

-^E J ^^[X{s)-^]^ [B{r)^Y{r) + D{r)^Z{r) + S{r)X{r)]~^ 

■ [B{r)^Y{r) + D{r)^Z{r) + 5(r)X(r)] X{s)-^^dr 
= E|c^E^[X(s)-i]^X(r)^GX(T)X(s)-i + ^ [X{s)-^]^X{r)^ Q{r)X{r)X{s)-^dr 

- i ^ [X(s)-i] ^ [B(r)^Y(r) + D{rfZ{r) + 5(r)X(r)] ^ 

• [B(r)'^Y(r) + D{ryZ{r) + S'(r)X(r)] X{s)-^dr ) ^ 

= E[eTM(s)C]. 
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Note that M(-) : [t,r] —S” is continuous. The result therefore follows. 

Now, let us introduce the following Riccati equation; 

{ P + PA + A^P + C^PC + Q 

- {PB + C^PD + S^) {R + D^PUy^ {B^P + PC + S') = 0, 

P{T) = G. 

A solution P{-) of (4.9) is said to be strongly regular if 

(4.10) R{s) + D{syP{s)D{s) ^ SI, a.e. s € [t,T], 

for some <5 > 0. The Riccati equation (4.9) is said to be strongly regularly solvable, if it admits a strongly 
regular solution. By a standard argument using Gronwall’s inequality, one can show that if the regular 
solution of (4.9) exists, it must be unique. Compared with the strongly regular solution, the notion of 
regular solution, which is closely related to the closed-loop strategy, was introduced in [26]. The interested 
reader is referred to [25] for further information. 

The following result shows that the strongly regular solvability of the Riccati equation (4.9) is necessary 
for the uniform convexity of the cost functional. 

Theorem 4.2. Let (H1)-(H2) and (H4) hold. Then the Riccati equation (4.9) is strongly regularly 
solvable. 

To prove the above result, we need the following lemma, whose proof can be found in [25]. 

Lemma 4.3. Let (H1)-(H2) hold. For any 0(-) G L^(t,T;R™^"), let Pe{-) G (^([t,Tj;S") be the 
solution to the following Lyapunov equation: 

(Pq + Pq(A + BQ) + (A + BOyPe + (C + D&yPe{C + DQ) 

(4.11) i yQ^iiQys^e + Q^S + Q = 0, a.e. s G [t,T], 

[ PeiT) = G. 

If there exists a constant /3 > 0 such that for all 0(-) G L^(t, T; R™^"), 

(4.12) Pe(s), R(s) + B(syP 0 (s)B(s) ^/SI a.e.sG[t,T], 

then the Riccati equation (4.9) is strongly regularly solvable. 

Proof of Theorem 4.2. We only need to show that the condition stated in Lemma 4.3 holds. To this end, 
let 0(-) G L^(t,T;R™^") and P(-) = Pei-) be the corresponding solution of (4.11). For any deterministic 
u{-) G L^(t,T;R"‘), let A“(-) be the solution of 

dX’^(s)= [(A + B0)X" + BuWjds + [(G + L>0)X^ + BuWjdW, sG [t,T], 

X^{t) = 0, 

v{-)^0i-)X-{-)+u{-)W{-)Gll[t,T]. 

E[A“(s)] = 0, E[n(s)]=0, s G [t,T]. 


(4.13) 
and set 

Clearly, 

(4.14) 


□ 


a.e. s G [t, T], 
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dX“(s) = {AX'^ + A¥.[X'^] + Bv + B¥.[v]}ds + {CX'^ + C¥.[X'^]+Dv + DW.[v]}dW, s e [t,T], 
X“(i) = 0 . 


By the uniqueness of solutions, X"(-) also solves 
(4.15) 

Thus, by applying Ito’s formula to s —(P(s)X“(s), X“(s)), we have (noting (H4) and (4.14)) 
(5E^ |0(s)X“(s) + M(s)lT(s)pds = (5E^ \v{s)\^ds ^ J°{t,Q-v[-)) 


= e| (GX“(r),X“(T))(gX“,X“) + 2(5'X",u) + (i?u,u) 


ds 


= E 


= E 


J {(PX“, X“) + (P [{A + P0)X“ + PulT], + (PX“, (A + P0)X“ + BuW) 

+ (P[(G + P0)X“ + PwlT], {C + P0)X“ + DuW) 

+ (gX“, X“) + 2(S'X“, 0X“ + mIT) + (P(0X“ + mIT), 0X“ + uW)^ds 

|2 ( [B^P + D^PC + S + {R + D^PD)Q] mTT) + ((P + P^PP)wlT, ulT)|ds. 


Hence, for any m(-) G i^(t,T;R™), the following holds: 


E 


(4.16) 


^ {2 ( [B^P + D^PC + S + {R + D^PD - d/)0] 1TX“, u) 

+ W‘^{{R + P^PP - SI)u,u)'^ds = |0(s)X"(s)pds ^ 0. 


Now, applying Ito’s formula again, we have 

dE[lT(s)X“(s)] = {[H(s)+ P(s)0(s)]E[lT(s)X“(s)] + sB{s)u{s)^ds, sG [t,T], 
E[W{t)X^{t)] =0. 

Fix any uq G M™, take u{s) = uol[t',t'+?i] (s), with t^t'<t' + h^T. Then 


E[VF(s)X“(s)] = 


0, s€[t,t'], 

psA{t' -\-h) 

$(s) / $(r)“^P(r)rito(ir, sG[t',P], 


where $(•) is the solution of the following ]R"^"-valued ordinary differential equation (ODE, for short): 

r <i>(s) = [H(s) + P(s)0(s)]$(s), s G [0,T], 
l<i>(0 )=/. 


Consequently, (4.16) becomes 

pt -\-h 


/ t +fi , ps 

|2 ( [B^P + D^PC + S+{R + D^PD - d/)0] $(s) J B{r)ruodr, uq) 

+ s ((P + PD — 6I)uo, Mo) |ds ^ 0. 

Dividing both sides by h and letting /i —^ 0, we obtain 

t'{[R{t') + D{t'YP{t')D{t')-5l]uQ,UQ)-^0, VmoGM™, a.e. t'G[t,r], 
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which implies that 

(4.17) R{s) + D{syP{s)Dis) ^ 61, a.e. s G [t,T]. 

Next, for any {s,x) € [t,T] x R", let X{-) be the solution of 

j dX{r) = [A{r) + B{r)Q{r)]X{r)dr + [C{r) + D{r)Q{r)]X{r)dW{r), r£ [s,T], 

\ X{s) = Wis)x, 

and set 

Similar to the previous argument, by applying Ito’s formula to r —>■ {P{r)X{r), X{r)), we can derive that 

(4.18) J^{s,W{s)x;w{-)) = E(P(s)bb(s)a;, bb(s)x) = s {P{s)x,x). 


By Proposition 4.1, we have 

s {P{s)x, x) = J°(s, VF(s)x; w{-)) > aE[|lP(s)xp] = sa|xp, V(s, x) G [t, T] x R", 


which implies that P{s) ^ al, Vs G [t,T]. The proof is completed. □ 

From Theorem 4.2, we see that the Riccati equation (4.9) is strongly regularly solvable under the uniform 
convexity condition (H4). With the strongly regular solution P(-) of (4.9), we may further introduce the 
following deterministic LQ optimal control problem. 


Consider the state equation 

fy(s)= [A(s)+A(s)] 2 /(s)+ [B(s)+R(s)]x(s), sG[t,T], 
1 y(t) = X, 


and cost functional 


(4.20) 

where 


(4.21) 


J{t,x;v{-))^{{G + G)y{T),y{T)) + 



(Tf'2/>2/) + 2(ry,'!;) + (Et>,w) 


ds, 


(T = Q + Q + {G + C)^P{G + C), 
J r = (D + D)^P{G + C)+S + S, 
[e = R + R+{D + DyP{D + D). 


We pose the following deterministic LQ problem. 


Problem (DLQ). For any given (t,x) G [0,T) x R", find a v*{-) G i^(t,T;R™), such that 


(4.22) 


J(t,x;v*(-)) = inf J(t,x;v(-)). 


Note that the Riccati equation associated with Problem (DLQ) is 

' ri + n(^ + 1) + (VI + i)^n + Q + Q + {G + cfp{G + c) 

-[IV{B + B) + {G + C)^P{D + D) + {S + S)^][R + R+{D + D)^P{D + D)\ 
' ■[{BpB)^I{ + {D + dYp{G + C) + {S + S)\=Q, a.e. sG[t,T], 

^ n(r) = g + G. 

We have the following result. 
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Theorem 4.4. Let (H1)-(H2) and (H4) hold. Then the map v{-) i—>• J{t,0;v{-)) is uniformly convex, 
i.e., there exists a A > 0 such that 


(4.24) 


J(i,0;a(-)) > A / |a(s)|2ds, Vv(-) € L^(t,T;R"^). 


Consequently, the strongly regular solution F(-) of the Riccati equation (4.9) satisfies 
(4.25) E = R + R+{D + D)^P{D + D)^0, 

and the Riccati equation (4.23) admits a unique solution n(-) G (^([i, T]; §"). 

Proof. Let P(-) be the strongly regular solution of the Riccati equation (4.9) and set 
0 = -{R + PD)-^{B^ P + PC P S) G 


We claim that 


(4.26) 


J\t, 0; 0(-)^(-) + ^^(•)) = 3{t. 0; 0(-)y(-) + v{-)), Va(-) e L^t, T; K™). 


To prove (4.26), take any u(-) G L^(t,T;R'"), let y{-) be the solution of 
(4.27) 


y{s) = [A(s) + ^(s)]y(s) + [B{s) + B{s)] [0(s)?/(s) + u(s)], s e [t,T], 

yit) = 0 , 


and W(-) be the solution of 

{ dX{s) = ^AX + AE[X] + B{eX + a) + BE[eX + u]|ds 

+ ^CX + CE[X] + D{ex + v) + DE[eX + v]'^dWis), sG [t,T], 

X{t) = 0. 

Note that u(-) is deterministic. Then 

J dE[W(s)] = {(A +A)E[X] + (P + P) (0E[A:] + u) }ds, s G [t,T], 

\ E[X(t)] = 0. 

By the uniqueness of solutions, we see that 

(4.29) E[W(s)] = 2 /(s), sG[t,T]. 

Now let z{-) = X{-) - E[X(-)]. Then 

f dz{s) = {ApBQ'jzds P |(C pDQ)z P {CpC)y P {DpD)(^QyPv)\d]P (s), s G [t,T], 

(4.30) < 

\z{t) = 0. 

Keep in mind that u(-) is deterministic and note that 


(4.31) 


0 = P + P{A P P0) P{AP P0)Tp + (C + P0)^P(C + DO) 
P 0^P0 + 5^0 + 0^5" + Q. 
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By applying Ito’s formula to s !->■ {P{s)z{s), z{s)) , we have (also, noting E[z] = 0) 

= e| {GX{T),X{T)) + (GE[X(r)], E[X(T)]) 

{QX, X) + (QE[X], E[X]) + 2 (5'X, QX + v)+2 (,5E[X], E[0X + v]) 
+ {R{ex + v), {QX + v)) + {RE[QX + r;],E[0X + ?;]) ds 

pT ^ 


pT , 


= E^{Gz{T)z{T)) + 

+ ((G + G)y(r),y(T)) 


{Qz, z) + 2{Sz, Qz) + {RQz, Qz) 


ds 


rT , 


{{Q + Q)y: y) + 2 ((S' + S)y, Qy + v) 


= E 


+ {{R + R){Qy + v),Qy + v) 
j {{Pz, z) + {P{A + BQ)z, z) + {Pz, {A + BQ)z) 

+ (P[(G + DQ)z + (G + C)y + {D + D){Qy + v )], 

(G + De)z + {G + C)y +{D + D){Qy + v)) 

+ ((Q + S^0 + 0TS + Q^RQ) z, z) }ds 


ds 


((G + G)y(T),y(T)) 


pT ^ 


{{Q + Q)y, y) + 2 ((S + S)y, Qy + v) 


ds 


+ {{R + R){Qy + v),Qy + v) 

{P[{G + C)y + {D + D){Qy + ^;)], (G + C)y + {D + D){Qy + v)) 


ds 


+ ((G + G) 2 /(T), 2 /(T)). 


pT ^ 


([Q + Q)y, y) + 2 ((S + S)y, Qy + v) 


ds 


+ {{R + R){Qy + v), Qy + v) 

= {{G + G)y{T), y{T)) + ^^ { ( [g + g + (G + G)^P(G + G)] j/, y) 

+ 2{[{D + G)Tp(G + G) + S + S] y, 0?/ + ?;) 

+ {[R + R+{D + D^PiD + D)] {Qy + v), Qy + v) }ds 

= J{t,0;Q{-)y{-) + v{-)). 

Thus, (4.26) holds. Consequently, by (H4), we have 

J{t, 0; 0(-)y(-) + v{-)) = J°{t, 0; Q{-)X{-) + v{-)) 

I^T i-T 

^SE \Q{s)X{s)+v{s)\'^ds^6 |E[0(s)X(s) + u(s)]|^ds 

Jt Jt 

^ ^ It V-i;(-) e L^(t,T;IR'"), 

which implies the uniform convexity of v{-) i—> J{t, 0; u(-)). The rest of the theorem follows now immediately 
from [25, Theorem 4.6]. □ 
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5 Sufficiency of the Riccati equations 


In the previous section, we proved that the solvability of the Riccati equations (4.9) and (4.23) is necessary 
for the uniform convexity of the cost functional. In this section, we shall show that it is also sufficient. 
Moreover, under the uniform convexity condition, the optimal control can be represented explicitly as a 
state feedback form via the solutions of the Riccati equations. 

First we need the following lemma. 


Lemma 5.1. Let (H1)-(H2) hold. For any u(-) € U[t,T], let Xq{-) be the solution of 

{ dX^is) = {a(s)Xo“(s) + ^(s)E[X“(s)] + B{s)u{s) + R(s)E[u(s)]}ds 

+ {c'(s)X“(s) +C(s)E[X“(s)] +D(s)u(s) +5(s)E[u(s)]}dVF(s), s e [t,T], 

X“(t)=0. 

Then for any 0(-),0(-) £ L^(t, T;R™^”), there exists a constant 7 > 0 such that 


E 


(5.2) 


j-T j-T 

J |u(s)-0(s)(Xo"(s)-E[X“(s)])|^ds> qEy \u{s)\^ds, Vu(-) £ W[t,T], 


|E[u(s)]-0(s)E[X“(s)]f 7 / |E[u(s)]|^ds, Vu(-) £ W[t,T]. 


Proof. Let 0(-) £ L^(t, T; R™^”). Define a bounded linear operator A : L([t,T] —>• U[t,T] by 


Au = u-e{X^ -E[X^]). 

Then A is bijective and its inverse A~^ is given by 

A-^u = li + 0 (lo“ - lE[Xo"]) , 

where Xq{-) is the solution of 

dX^{s) = {(A + BQ)X^ + (^ - .B0)E[lo“] +Bu + RE[u]}ds 

+ {(C' + D0)Xo“ + (C-D0)E[X“] +Du + DE[u]}dW{s), s £ [t,T], 

XSit) = 0 . 

By the bounded inverse theorem, A~^ is bounded with norm ||7l“^|| > 0. Thus, 

E^ \u{s)\'^ ds = E \{A~^Au){s)\'^ds^\\A~^\\Ej^ \{Au){s)\'^ds 

= h(s) - 0(s)(^o (s) - E[X“(s)]) \^ds, Vu(-) £ U[t,T], 

which implies the first inequality in (5.2) with 7 = 

To prove the second, for any v{-) £ L^(t, T;R™^"), let ?/”(•) be the solution to the following ODE: 

I y''(s) = [^(s) + A(s)]?/’'(s) + [R(s)+i?(s)]u(s), s£[t,r], 

(5.3) < 

\y^{t)=0. 

For 0(-) £ L^(t,T;R"*^"), we define a bounded linear operator B : L^(t,T;R’") —L^(<,T;R"*) by 

Bv = v- Qy'^. 
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Similar to the previous argument, one can show that B is invertible and 

|r;(s) - ^ Hs)\^ds, M') £ T; K-x"). 

Observe that E[Xg (•)] satisfies (5.3) with v{-) = E[u(-)]. The result therefore follows. □ 

Now we present the main result of this section, which gives a characterization for the uniform convexity 
of the cost functional as well as a feedback representation of the optimal control. 

Theorem 5.2. Let (H1)-(H2) hold. Then the map u(-) >—?■ J^(t, 0; u(-)) is uniformly convex if and only 
if the Riccati equation (4.9) admits a strongly regular solution P{-) such that 

(5.4) i: = R + R+{D + D)^P{D + D)^0, 

and the corresponding Riccati equation (4.23) admits a solution n(-). In this case, the unique optimal u*{-) 
of Problem (MF-LQ) at (t,^) is given by 

u* = Q{X* - E[X*]) + 0E[X*] +ip- E[ip] + (p, 

' 0 = -{R + PD)-^{B^P + D^PC + S), 

0 = -E-i [{B + B^U +iD + DyP{C + C) + {S + 5)], 

^ = -(R + D^PD)-^ [B^r] + D^iC + Pa) + p ], 

^ p = -E-i {(B + B)^fj +{D + D)^ (E[C] + PE[a]) + E[p] + p }, 

with (?7(-)iC(')) f]{-) being the (adapted) solutions to the following BSDE 

( drj{s) = -[(A + B&)^p +(C + O0)^C + (C + De)^Pa 
(5.7) \ + 0^p + Pb + gj ds + ^dW (s), s G [t, T), 

[ v{T) = g, 

and ordinary differential equation 

( fj+[(A + A) + (B + B)&ffj + e^\^iD + D)^{PE[a]+E[C]) +E[p]+p} 

(5-8) < +((:7 + C)^(PE[a]+E[C])+E[g ]+9 + nE[ 6 ] = 0, a.e. se[t,T], 

[fj{T) =E[g]+g, 

respectively, and X*(-) is the solution of the closed-loop system 

{ dX*{s) = {(^ + P0)(X*- E[X*]) + [(A + A) + {B + P)0]E[X*] + b^ds 

+ {(C + P0)(X*-E[X*]) + [(C + C) + (P + L))0]E[X*]+(T}dfF(s), sG [t,T], 

X*it)=^. 

Moreover, the value V{t,^) is given by 

V(t, 0 = E {P(m - EK]) + 2r;(t), c - EKl) + (n(t)E[C] + 2^(t), E[^]) 

(5.10) +E^ {{Pa,a)+2{g,b-E[b]) + 2{C,a)+2{fj,E[b]) 

- (Eo(</ 5-EM),‘7’-EM) - (E(^, <^)|ds, 

where Eg = P + PD. 


(5.5) 
where 

(5.6) 
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Proof. The “only if” part has been proved in Section 4. Let us now show the “if” part. For any 
( G L3rj(n;R”) and it(-) G U[t,T], let X{-) = X{- be the corresponding solution of (1.1). Set 


Then 


(5.11) 


z(.) = X(.)-E[X(.)], u(.) = 4-)-EK)], y{-)=E[X{-)]. 

dz{s) = ^Az + Bv + b — ]E[ 6 ] |c?s 

+ + Dv + (T + (C + C)j/ + [D + i5)]E[rt] j’dLF(s), s G [t, T] , 

zit)=i-E[f], 


and 

(5.12) 


I 2/ — (^ + ■^)y + {B + il)E[u] + E[ 6 ], s G [t, T], 

1 yit) = E^]. 

Now we rewrite the cost functional as follows: 


J{t, u(.)) = eJ {Gz{T) + 2g, z{T)) + 



(5.13) 


{iG + G)yiT) + 2{E[g]+g),yiT)) 

^! (q+q {s+sy\ ( y \ i y 

, E[m] / ’ I E[u] 


/ /E[g]+ 9 \ / y 


\ \E[p]+py ’ \E[u] 


R+R 

Applying Ito’s formula to s !->■ {P{s)z{s) + 2r;(s), z{s)), we have (noting E[ 2 ;] = 0,E[?;] = 0) 
E{Gz{T) + 2g, z{T)) - E(P(t)(^ - E[e]) + 2g{t), ^ - E^]) 


+ E^ {Qz,z) + 2{Sz,v) + {Rv,v) + 2{q,z) + 2{p,v) 

j (Pz, z) + {P{Az + Bv + b- E[ 6 ]), z) + (Pz, {Az + Bv + b- E[ 6 ])) 

+ {P{Gz + Dv + a+{C + C)y+iD + .D)EM}, 

Gz + Dv + a + {C + C)y + {D + £>)£[«]) 

- 2((A + BQ^y + {G + De)'^C + (C + DQ)^Pa + p + Pb + q, z) 

+ 2 ( 77 , Az + Bv + b — E[ 6 ]) 


ds 


= E 


+ 2(C, Cz + Dv + a + {G + C)y + {D + .D)E[m]) 

i-T , 


ds 


+ E 


ds 


= E 


{Qz, z) + 2{Sz, v) + {Rv, v) + 2(g, z) + 2(p, v) 

^ [{{P + PA + A^P + G^PG + Q)z, z) + 2( {PB + PD + S^)v, z) 

+ {{R + D^PD)v, v) + 2{B^g + D^ f + D^Pa + p,v - Qz) 

+ 2(PE[a] + E[C], {G + C)y + (D + .D)E[u]) 

+ {P{{G + C)y + {D + D)E[u]}, {G + C)y + {D + D)E[u]) 


+ {Per, cr) + 2 ( 77 , b - E[5]) + 2(C, a) 


ds 


= E 


( 0 ^Eo 02 , z) — 2 (Q^Eqv, z) + {Eqv, v) — 2{Eo(p, v — Qz) 

+ ((C + C)'^P{G + C)y, y) + 2((C + C)'^P{D + .D)EM, y) 


ds 



ds. 
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+ {{D + DfP{D + L))E[w], E[m]) + 2{{C + C)^ {PE[a] + E[C]), y) 

+ 2((D + Dy {PE[a] + E[C]), EM) + {Pa, a) + 2{y, b - E[6]) + 2(C, a) 


ds 


{Eo{v - Qz - ip),v - Qz - ip) - {Eoip,ip) 

+ ((C + C)^P{C + C)y, y) + 2((C + Cf P{D + D)E[u],y) 

+ {{D + D)^P{D + L))EM,EM) + 2({C + C)^ {PE[a] + E[C]), y) 


(5.14) 


= E 


+ 2{{D + D)^ {PE[a] + E[C]), E^) + {Pa, a)+2{r],b- E[ 6 ]) + 2(C, a) 
Applying the integration by parts formula to s i—>■ (n(s)y(s) + 2fj{s),y{s)), we have 
((G + G)y(T) + 2 (E[ 5 ] + g), y{T)) - (n(t)EM + 2fj{t), EM) 

/ ( E[y] + q\ ( y 


ds. 


/ (q + Q iS + Sy\ ( y 



T , 


(5.15) 


\\S + S R + R 

(riy , y) + (n{ (A + A)y + {B + B)E[u\ + E[b]} , y) 

+ (Uy, {A + A)y +{B + B)E[u] + E[6]) 

+ 2(M y) + 2(y, {A + A)y +{B P B)E[u] + E[6]) 


\\^E[p]+py’\^EM 



ds 


ds 


+ [((g + g)y,y) + 2((^+5)y,EM) + ((i?+i?)EM,EM) + 2(E[g] + g,y) + 2(E[p]+p,EM) 

= J [n + n(A + A) + (A + A)^n + <5 + 0 ]yjy) 

+ 2( [n(B + B) + {S + 5)^]EM, y) + 2{fj + (A + A^fj + E[q] +q + nE[6], y) 

+ 2{{B + B^fj + E[p] + p, EM) + {{R + i?)EM, EM) + 2 ( 77 , E[6]) }ds. 

Adding (5.14) and (5.15) together and noting (5.13), we obtain 

J{t, e; «(•)) - E{P{m - EM) + 2y(t), ^ - EM) - (n(t)EM + 277 ( 1 ), EM) 

= E 


ds 


+ 


= E 


+ 


= E 


£ 0 ( 7 ; - Qz - (p),v - Qz - (fi) - {Eqp, (fi) 

+ {Pa, a) + 2{g, b - E[6]) + 2(C, a) + 2{fj, E[6]) }ds 
n + n(A + A) + (A + A)^n + Q + Q + {C + G)^P(C + G)] y, y) 

+ 2 ( [U{B + B) + {C + C^PiD + D) + {S + 5)T]EM, y) 

+ {[R + R+{D + D)^P{D + D)] EM, EM) 

+ 2{fj + (A + A^fj + (G + Cy {PE[a] + EM) + EM +q + nE[5], y) 
+ 2{{B + B)^fi +{D + D)^ (PEM] + EM) + E^ + p, E[M) }ds 

Eo{v - Qz - (p),v - Qz - (p) - {Eop, p) 

+ {Pa, a) + 2(y, b - E[ 6 ]) + 2(C, a) + 2{fj, E[ 6 ]) }ds 
|(0^S0y,y) - 2(0^EE[u],y) + (EE[-ii],E[u]) - 2{Eip,E[u\ - 0y)|ds 
Eo{v - Qz - p),v - Qz - p) - {Eop, p) 
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+ - Qy-^),E[u\ -Qy-ip) - (£(/?,(/?) 

+ (Pct, g) + 2 ( 77 , b - E[ 6 ]) + 2(C, a) + 2{fj, E[&])}ds 

(5.16) =E^ {(Pa,a)+2(77,6-E[6]) + 2(C,a)+2(77,E[6])-(E^,(^) 

- (Eo ((/3 - E[(p ]),(/3 - E[(p]) + {Eo{v -Qz- (/? + E[(p]), 7 ; - Qz - + E[(/ 3 ]) 

+ (E(E[m] — 0y — (f ), E[u] — Oy — (p) |(is. 

Since Eq, E 0, (5.16) implies that 

J{t, n(-)) ^ nPim - EKl) + 277(1), ^ - E[e]) + {n{t)E[^] + 277 ( 1 ), E^]) 

(5.17) +E^ {(Pa,77)+2(77,6-E[6]) + 2(C,a)+2(77,E[6]) 

- (Eo(‘/? - E[(/ 7 ]), (/? - E[(/ 3 ]) - (E<p, <p)|ds, 

with the equality holding if and only if 

j u- E[m] =v = ez + ip- E[v 9 ] = Q{X - E[X]) +ip- E[(/ 3 ], 

\ E[u] = 07/ + (^ = 0E[X] + ip, 

which is also equivalent to 

(5.18) u = 0(X — E[X]) + 0E[X] + ip — E[(/j] + ip. 

In particular, when b{-),a{-), g{-),g{-),q{-),q{-), p{-), p{-) = 0, we have 

(^(•):C(-)) = ( 0 > 0 ), 7?(-)=0, (p(-) = (p(-) = 0 . 

Take ^ = 0. Then X{-) satisfies 

dX{s) = {^(s)X(s) + ^(s)E[X(s)] + B{s)u{s) + .B(s)E[u(s)]}ds 

+ {C'(s)ds:(s)+ (5(s)E[X(s)]+ i:i(s)w(s)+£)(s)E[rt(s)]}dVF(s), sS [l,r], 

X{t) = 0, 
and (5.16) becomes 

J°(1,0;m(-)) =E^ {(Eo[m-E[u] -0(X-E[X])],m-E[u] -0(X-E[X])) 

+ (E(E[u] - 0 E[X]),E[m] - 0E[X])}ds. 

Noting that ^ SI for some 5 > 0 and making use of Lemma 5.1, we have 

J° ( 1 ,0; u(-)) ^ <5E ^ { |u - E[m] - 0(X - E[X])|^ + |E[u] - 0E[X] }ds 
(5.21) |M-0(X-E[X])|2-2(M-0(X-E[X]),E[u]) + (l + 7 )|E[u]| 2 ds 

|u-0(X-E[X])p(is ^ ^^E^ | 7 i(s)p(ls, Vm(-) e W[ 1 ,T], 

for some 7 > 0. The uniform convexity of u(-) 1 —>■ J°(1,0;m(-)) follows immediately. 


(5.19) 


(5.20) 
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Note that for Problem (MF-LQ)° (where g{-), p{-), p{-) = 0), under the uniform 

convexity condition (H4), the value at (t,^) is given by 

(5.22) i/0(t, 0 = E {P{tm - EK]), e - E^]) + (n(t)EK],E^]), 

where P(-) and !!(•) are the solutions to the Riccati equations (4.9) and (4.23), respectively. The unique 
optimal u*{-) is given by 

(5.23) u* = 0(X*-E[X*])+0E[X*], 
where 0(-),0(-) are defined by (5.6) and X*{-) is the solution of 

{ dX*{s) = {(A + B0)(X*- E[X*]) + [(A + A)+ {B + P)0]E[X*]}ds 

+ {(C + P0)(X*-E[X*])+ [{C + C) + {D + D)e]E[X*]}dW{s), sG [t,T], 

X*{t)=^. 


To conclude this section, we present a sufficient condition for the uniform convexity of the cost functional. 
From the following result, we will see that (1.4) implies the uniform convexity condition (144). However, the 
converse fails. A counterexample will be present in the next section (see Example 6.1). 


(5.25) 


a.e. s G [t, T], 


Proposition 5.3. Let (H1)-(H2) hold and t G [0,T) be given. If there exists a constant 5 > 0 such that 
G, G + G^O, R{s), Ris) + R{s) ^ SI, g(s) - S'(s)^P(s)-^S'(s) ^ 0, 

Q(s) + Qis) - [5(s) + 5(s)] ^ [i?(s) + P(s)] [Sis) + 5(s)] > 0, 
then the map u(-) i—> J*^(t, 0; «(•)) is uniformly convex. 

Proof. For any u(-) G G[t,T], let Aq (•) be the solution of (5.1). Then 


J°(t,0;u(-)) =E (G(A“(r)-E[A“(r)]),A“(T)-E[A“(r)]) 




'Q S^] fXo^-E[XoA 

u — E[m] 


Jt \\S R) 

((G + G)E[A“(T)],E[A“(r)]) 

.rl(Q + Q (5 + 5)^We[A“] 

Jt \\s + s R + R )\ E[u] 


X)f - E[Ao“] 
u — E[m] 

\ /e[A“]^ 
/ ’ I EM J 


ds 


ds 


= E 


^ E^ { (Q(A“ - E[A“]), A“ - E[A“]) + 2 {S{XS - E[A“]),u - EM) 

+ (i?(M — EM) I u — EM) ^ds 

+ j { ((g + g)E[A“],E[A“]) + 2 ((5 + 5)E[A“],EM) + {{R + P)EM,EM) }ds 

{ ((g - S^R-^S) (A“ - E[A“]), XS - E[A“]) 

+ {R[u - EM + R~^S{X^ - E[A“])], u - EM + R~^S{X^ - E[A“])) }ds 
+ {{[Q + Q-iS + S)^iR + R)-\S + 5)]E[A“],E[A“]) 

+ <J(P + i?) (eM + iR + R)-\S + 5)E[Ao“]),EM + iR + R)-HS + 5)E[A“]^ }ds 

/ T _ _ 

|u-EM+4?”^5'(Ao"-E[Ao"])|^ds + ,5 |EM + (i? + 4?)”^(*S'+ S')E[A“]|^ ds. 


^ (5E 
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Consequently, by Lemma 5.1 (taking 0 = —R and 0 = —{R + R) ^(S' + S')), we have 

6E { |M-]E[u]+S-^S(X“-E[X“])|V7|E[M]|2jds 


(5.26) 


^7 


^ —^E 
1 + 7 Jt 


rT 

\u + R-^S{X^-E[X^])\^ds 




^E^ |u(s)pds, VM(-)eW[t,T], 
for some 7 > 0. This completes the proof. 


6 Examples 

In this section we present two illustrative examples. In the first example, the condition (1.4) does not hold, 
but the corresponding Riccati equations are still solvable. Thus, by Theorem 5.2, the cost functional is 
uniformly convex. This example shows that the uniform convexity condition (H4) is indeed weaker than 
(1.4). 

Example 6.1. Consider the following Problem (MF-LQ)° with one-dimensional state equation 
J dX{s) = {E[X(s)] -I- u{s) + E[u(s)]}ds -I- V2u{s)dW{s)^ s € [t, 1 ], 

I xit) = e. 


( 6 . 1 ) I 

and cost functional 


(6.2) J{t, u{-)) = E |g|X(1)|2 + G |E[X(1)]|' + j' (r(s)|u(s)|' + i?(s)|EKs)]|2)ds|, 


where 


G = 8 , 


G = —a — 8 with 0 < a < 


2 (e 2 -l)’ 

\i?(s) = (s + l)3-4(s + l)2, R(^s) = l-{S+If, se[0,l]. 

The Riccati equations for the above problem are 

P(l) = 8, 


and 


Clearly, 


ri(s) -f 2n(s) - 
n(l) = -a. 


4n(s)2 


i?(s) -k i?(s) -k 2P{s) 


= 0 , 


G-kG = -a<0, i?(s) = (s-kl)^(s-3) <-2, i?(s)-k R(s) = 1 - 4(s-k 1)^ ^-3, sG[0,1]. 

Hence, the condition (1.4) does not hold. However, one can verify that the above Riccati equations are 
solvable on the whole interval [ 0 , 1 ] with solutions given by 


P(s) = 2(s + 1)2, n(s) = 


ae 


2(l-s) 


2a[e2(i-+ - 1] - 1 


< 0, s G [0,1]. 
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Note that 


SG [0,1], 


J R{s) + D{syP{s)D{s) = (s + 1)3 ^ 1, 

\ Ris) + R{s) + [D{s) + D{s)]^P{s)[D{s) + D{s)] = 1, 

By Theorem 5.2, the cost functional J(t,^;u{-)) is uniformly convex in u{-), and for any initial pair (t,^) G 
[0,1) X the problem admits a unique optimal control u*{-) given by 


u*{s) = -j^X*{s) + 


s + 1 


-2n(s) 


E[X*(s)], sG[t,l] 


with X*(-) being the solution to the following closed-loop system: 


dX*{s) = \ --X*(s) + 


s -I- 1 

2V2 

s -|- 2 


s -t- 3 


s -t- 2 

X*{s) + 2V2 


- 4n(s) 

1 


s -I- 1 


E[X*(s)] Us 


-n(s) 


E[X*(s)] UlT(s), 


G l]j 


[x*{t)=^. 


Now we present an example in which the mean-field LQ problem is open-loop solvable, but the cost 
functional is not uniformly convex. Hence, the optimal control cannot be constructed directly in terms of 
the Riccati equations. However, an optimal could still be found by making use of Theorem 3.2 and 5.2. 


Example 6.2. Consider the following Problem (MF-LQ)° with one-dimensional state equation 
(6.3) 


dX{s) = {^(s) — E[X(s)] -I- E[u(s)]}ds -I- n(s)dlT(s), s G [t,T], 


and cost functional 

(6.4) J(t,e;U)) =IE|2U(T)|U|E[X(r)]|U^^(-4|X(s)p-Ks)|U4|E[X(s)]|"-|E[n(s)]p)ds| . 

In this example, 

JH = 1, H = -1, B = 0, B = l, C = C = 0, D = l, D = 0, 

jG = 2, G = l, Q = -4, Q = 4, 5 = 5 = 0, R = R = -1. 

Clearly, the condition (1.4) does not hold. The Riccati equations for the problem are 

s G [t, T], 


(6.5) 


and 


( 6 . 6 ) 


J P(s) -k 2P(s) -4 = 0, 

I P{T) = 2, 


n(T) = 3 . 


s G [t, T], 


It is easy to see that P(-) = 2 is the unique solution of (6.5). However, since 

P(s) -k P(s) -k [P(s) -f P>(s)]’^P(s)[P(s) -k .D(s)] = P(s) -2 = 0, s G [t, T], 
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we cannot use (6.6) to solve the problem directly. To investigate the open-loop solvability of the above 
problem, let us now consider the following cost functionals for £ > 0: 


(6.7) 


■«(•)) = >^(<,C;m(-)) \u{s)fds 


= E 


2|X(T)|2 + |E[X(r)]|2 + / (- + (^ - + 4 |E[^(s)]|' - |EKs)]p)ds [ • 


We denote the corresponding mean-field LQ problem and value function by Problem (MF-LQ)° and V ^{-, •), 
respectively. The Riccati equations for Problem (MF-LQ)° are 

rP,(s)+2Pas)-4 = 0, s€[t,T], 

\PeiT) = 2, 

and 

[n,(T) = 3. 

A straightforward calculation leads to 

Peis) =2, neis) = —^ - se[t,T]. 

e + 3{1 — s) 

Since 

R + e + PeD = l+e, R + e + R+{D + D)^ PeiD + D) = e, 

by Theorem 5.2, the map u(-) >->• Jeit^ 0; u(-)) is uniformly convex for all £ > 0 and hence u(-) >->■ J(t, 0; u(-)) 
is convex. Moreover, 


(6.8) R,°(t,e) =^{Peim - E[e]),e - E[e]) + (nat)E[e],E[e]), 


and the unique optimal control of Problem (MF-LQ)° at (t,^) is given by 
(6.9) «*(,) = _II^E[A*(s)], sG[t,n 

with X*i-) being the solution to the following closed-loop system: 

I dx:is) = |x*(s) - (l + E[A;(s)]|ds- ^^^EK(s)]dVF(s), s e [t,T], 

\x:it) = ^. 


Letting £ —>■ 0 in (6.8), we have from Theorem 3.2 that 

( 6 . 10 ) 

Note that 


R°(t,e) = im^(t,e) = 

£—)-0 


2var[^], 

2EK2] + (EK])^ 


dE[X:is)] = -^^E[X:is)]ds, 
E[X;it)]=E[^]. 


0 ^ t < T, 
t = T. 


s £ [t,T], 


Hence, 

E[X,*(s)] = EK] exp J ^ 
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and 


s £ [t, T], 


uUs) = 


e ‘ £ _j_ 

It is clear that for t £ [0,T), u*(s) converges uniformly to 

EK] 


( 6 . 11 ) 




T-t 


e [t,n 


which, by Theorem 3.2, is an optimal control of the original problem at (t,^). 
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